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Abstract — This paper considers a two-user Gaussian interfer- 
ence channel with energy harvesting transmitters. Different than 
conventional battery powered wireless nodes, energy harvesting 
transmitters have to adapt transmission to availability of energy 
at a particular instant. In this setting, the optimal power 
allocation problem to maximize the sum throughput with a given 
deadline is formulated. The convergence of the proposed iterative 
coordinate descent method for the problem is proved and the 
short-term throughput maximizing offline power allocation policy 
is found. Examples for interference regions with known sum 
capacities are given with directional water-flUing interpretations. 
Next, stochastic data arrivals are addressed. Finally online and/or 
distributed near-optimal policies are proposed. Performance of 
the proposed algorithms are demonstrated through simulations. 

Index Terms — Energy harvesting networks, interference chan- 
nel, sum-throughput maximization, data arrivals, directional 
water-filling, generalized iterative water-filling. 

I. Introduction 

Recent advances in energy harvesting and the advocacy 
for green technologies are leading to significant interest in 
systems powered by harvested ambient energy. In wireless 
communications, energy harvesting does more than reducing 
the carbon footprint of today's high rate wireless voice and 
data systems: It also makes available self-sustaining wireless 
networks with an indefinite lifetime. Such ease of deployment 
and maintenance for wireless nodes as well as a growing 
demand for high rate communications foresee a rapid increase 
in number of energy harvesting communication devices in the 
near future. Given these advantages, one can forecast that there 
shall be growing interest in wireless networks comprised of 
energy harvesting nodes. 

The design principles of energy harvesting wireless net- 
works are fundamentally different than their traditional coun- 
terparts: In order to utilize the wireless and the energy re- 
sources in the best possible way, the network needs to be 
optimized subject to the constraints on the instantaneously 
available energy. Energy availability is stochastic and uneven 
throughout operation, and the battery to store the harvested 
energy is limited in practice. A particularly important network 
structure is one that addresses the case where multiple energy 
harvesting transmitters share the wireless medium to commu- 
nicate to multiple destinations, i.e., a wireless ad hoc network 
with interference. In this paper, we consider the simplest 
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such setting, the two-user interference channel, and solve the 
optimum power scheduling problem that maximizes short-term 
sum throughput of this system under a deadline when the two 
transmitters obtain the transmission energy by harvesting from 
ambient sources. 

Optimal power policies for energy harvesting nodes have 
attracted recent interest in the research community. As men- 
tioned above, the essence of the problem is adapting transmis- 
sion power to energy availability. One approach is to sustain 
a performance while preserving a balance between harvested 
and consumed energy, i.e., energy neutrality [I]. References 
121, 131 provide energy neutrality by stabilizing an energy 
queue. This approach often calls for the energy queue to grow 
indefinitely large for optimal operation, thus is not applicable 
to nodes with limited battery capacity. An alternative approach 
enforcing strict energy constraints is considered in 14], where 
transmission time for a given amount of data is optimized over 
power allocations that obey a known energy arrival scheme. 
This work has been subsequently extended to the problem of 
maximizing transmitted data by a deadline with the addition 
of a battery capacity constraint in Q, and battery imperfec- 
tions in 0. A model incorporating channel fading to these 
problems is introduced in Q and solved using a directional 
water-filling algorithm. While these early works considered a 
single user setting, i.e., one energy harvesting transmitter and 
one receiver, more recently, settings with either one energy 
harvesting transmitter broadcasting to multiple receivers l8l, 
l9l , or multiple energy-harvesting transmitters communicating 
to one receiver ifTOl have also been considered. In contrast, we, 
in this paper, focus on the scenario with multiple transmitters 
and multiple receivers, i.e., the interference channel. 

The interference channel is a fundamental building block 
for wireless networks. Consequently, identifying the "correct" 
transmission policies under energy harvesting scenario for 
this channel, will furnish us with insights needed for energy 
harvesting wireless ad hoc network design. A critical issue is 
the lack of conclusive results on the capacity of the interfer- 
ence channel. For the Gaussian two-user interference channel, 
which is our focus, the strong interference capacity region 
was characterized earlier in ITTI . Additional recent results 
with respect to the capacity region and weak interference sum 
capacity have been obtained in ||T2| . lT3l . The known sum- 
capacity results point out the fact that the capacity is notably 
influenced by the interaction of the transmitters, and how 
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interference is processed at the receivers lfT2ll . Considering 
that the energy availabilities of energy harvesting nodes are 
varying, the problem of optimal power allocation in this setting 
becomes an interesting one to tackle. 

The focus of this paper is on short-term throughout op- 
timization in a two-user Gaussian interference channel with 
energy harvesting transmitters. The problem of transmitting 
the maximum total number of bits for a given deadline is 
considered. First, it is shown that an iterative coordinate 
descent algorithm optimizing individual power allocations at 
each iteration converges to the optimal solution for a jointly 
concave sum-rate expression when all data is available for 
transmission beforehand. This suggests performing single user 
generalized directional water-filling algorithms iteratively al- 
ternating between the users to find the optimal power allo- 
cation. Then, examples for specific interference regions are 
presented for which parts of the solution reduces to simpler 
directional water-filling algorithms. In general, it is observed 
that variations of the directional water-filling algorithm is 
necessary to adapt to energy arrivals and interference in 
the optimal policy. Next, the solution is extended to the 
scenario when data arrivals, just like harvested energy, occur 
intermittently during the communication. A modified version 
of the directional water-filling algorithm which handles data 
causality through a penalty function was proposed. Finally, 
distributed and online algorithms are proposed. 

The paper is structured as follows. In Section|II] we describe 
the general system model, with energy and packet arrivals to 
both transmitters in any interference region as well as the 
problem definition. In Section |III] we present the iterative 
algorithm and prove its convergence. Some examples for the 
iterative algorithm in different interference regions are given 
in Section |IV] with all data available at the beginning of 
transmission. In Section |V] the extension to a setting with 
intermittent packet arrivals is considered. In Section [VT] some 
near-optimal algorithms are proposed, which are subsequently 
simulated in Section IVIII Section IVIIII concludes the paper 

II. System Model 

The two-user Gaussian interference channel with energy 
harvesting transmitters is shown in Figure [T] Transmitters Tl 
and T2 have independent data packets addressed to corre- 
sponding receivers Ri and i?2. The transmitters are powered 
by independent energy harvesting processes, the energy from 
which are stored in batteries of size Ei^max and £'2, max 
respectively. The harvested energies and battery capacities 
are normalized to the corresponding transmitter-receiver link 
gain and receiver noise level, yielding unitary direct channel 
coefficients and noise variances. After this normalization for 
each transmitter, the cross channel coefficients become ^Ja 
and \/h and the channel outputs are expressed as 

Yi=Xi + ^iX2 + Zi, Y2^VhXi+ X2 + Zi (1) 

where Yi and are received at Rl and i?2, Xi and X2 
are channel inputs by T\ and T2 normalized to have unit 
channel gains at their corresponding receivers, and Zi and Z2 
are zero-mean Gaussian random variables with unit variance. 




Fig. 1: Interference channel model with energy harvesting and 
data arrivals. 



Using this model, reference lfT2ll reports sum capacity results 
for the Gaussian interference channel for ranges for a and 6 
as summarized in [12, Table 1]. The sum rate as a function of 
the powers of transmitters will be referred to as the power-rate 
function r{pi , P2) in the sequel, and individual achievable rates 
will be denoted with rj{pi,p2)- Specific regions for a and b 
will be denoted as a superscript when needed. It is assumed 
for the sake of simplicity that transmission is the dominant 
source of energy expenditure in the system, and other factors 
such as base power or processing power are ignored. Possible 
effects of these factors are discussed in Section HiH 

The energy harvesting process and the packet arrival process 
for node j e 1,2 are denoted in Figure |2] with red and 
blue arrows respectively. We assume a time slotted systerrQ 
with slots of length r, where a normalized energy of Ej^i 
units and a data packet of size Bj^i bits are received by 
transmitter j at the beginning of time slot i and is available for 
immediate use within that time slot. Since an instantaneous en- 
ergy consumption requires infinite instantaneous power which 
is impractical, the energy harvests must be stored in the 
battery before consumption. Thus any arrival exceeding the 
respective battery capacity is irreversibly lost, and an arrival 
larger than the respective battery capacity is truncated in the 
model accordingly. Arriving data packets are stored in the 
data buffer as well, only without a buffer size restriction. For 
optimal policy analysis, it is assumed in Sections Ullirvl that the 
arrival scheme is perfectly and non-causally known by both 
transmitters before transmission. This problem is referred to 
as the offline problem. Near-optimal algorithms with online or 
non-centralized decisions are put forth in Section [VT] 

There are multiple constraints in this model for a feasible 
selection of a transmission policy. The first constraint is the 
energy causality in the sense that no more than the already 
harvested amount of energy shall be consumed up to a time 
in transmission. Denoting the transmission power of user j 
over time slot i as pj^i, the constraint for time slot n can be 

' A time-slotted model is preferred over the continuous time discrete arrival 
models in (4), O, Q for notational simplicity. 
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Fig. 2: Energy harvests and data arrivals in the time-slotted 
model. 



expressed as 



(2) 



1=1 



where j is the transmitter index chosen from the set {1,2}. 
Note that assuming constant power transmission within a time 
slot is optimal, as proved in 2). Secondly, it is shown in fS) 
that a battery overflow is undesirable since any overflowing en- 
ergy can be consumed prior to the overflow, strictly increasing 
the utility. This argument applies to the interference channel 
as well since r{pi,p2) is increasing in pi and p2 by definition. 
The implication is that at the end of time slot n, there should 
be sufficient space in the battery to accommodate the next 
harvest En+i- Therefore the battery capacity constraint, 

n n+1 
E 'T ■ P3,i + Ej.max " E ^^J'* - ^ 



i=l 



1=1 



is to be met for every n over the transmission. Note that it 
is possible for a transmitter to not have any extra bits in the 
data queue when a battery overflow is imminent, rendering 
overflow avoidance practically useless. This special case is 
discussed in detail in Section |V] The final constraint is data 
causality, implying that no more than the available amount of 
data can be transmitted until the end of the n*^ slot for every 
n throughout the transmission. 



(4) 



i=l i=l 



We define the problem of maximizing the total number of 
bits sent by the transmitter until a deadline T = N - t, i.e., 
time slots, as the short-term throughput maximization problem, 
which can be expressed as follows: 



N 



max 

Pl>0,P2> 



■ r{pi^^,P2,i) (5a) 

i=l 

s.t. E (^jV< - ^ • PjvO > 0, (5b) 

i=l 

n 

E ■ Pj,i - + Ej^rnax ^ £^J,J+1 > 0, (5c) 

i=l 
n 

E(Sj>-^-'^jfevO)>0, n=l,...,iV, .7 £{1,2}. 

(5d) 

In Q, the vector pj represents the collection of transmission 



powers of user j, and will be referred to as the power policy or 
the power allocation vector of user j in the sequel. Constraints 
( |5bb and ( fSdl i correspond to energy causality, battery constraint 
and data causahty respectively. The expression Pj >0 implies 
component-wise non-negativity on the transmission power 
vector. 

We shall first focus on the case where an infinite backlog 
of data is available at both transmitters at the beginning of 
transmission, and ignore the data causality constraint given in 
(l5d] l. We include ( fSdl i. and extend our approach to the problem 
with data arrivals in Section [V] 

III. Iterative Solution 

In this section, we employ an iterative approach to solve 
the two user optimization problem defined in ^ without the 
data causality constraint in ( fSdl i. In particular, we show the 
convergence of the cyclic coordinate descent method where 
the two coordinates are chosen as the power allocation vectors 
of the two users, namely pi and p2- 

A. Iterative Algorithm 

The proposed algorithm is to solve the two user interference 
channel problem by iteratively maximizing the throughput 
over the transmission policy of one user while keeping the 
other policy constant until both policies converge to the opti- 
mal vector. Starting from Tl and an arbitrary initial feasible 
pair (p^jP^), the following update for the power policies is 
performed on the fc*'' iteration: 

N 



= arg max ■ r{pi^,,p'^/) 



pi>0 



i=l 



S.t. E i'^ ■ ~ -^1/0 + El^max - > 0, 



E(^^l.^-^•Pl,^)>0, n=l,...,N 



(6) 



N 



p\ = arg max ^ r • r{p\^^,p2,^) 



P2>0 



i=l 



S.t. E ■ P2,* - E2,^) + E2 .max — E2,n+1 > 0, 



j=l 



E (^2,t - T • P2,i) > 0, 71=1, 



(7) 



Note that the energy constraints for only the optimized 
vector is included in each problem. This is due to the other 
vector being fixed as the output of a previous iteration, or as 
the feasible initial point, implying its feasibility regardless of 
the value of the optimized vector. This is possible since the 
constraints are not coupled due to the transmitters harvesting 
energy independently and consuming their own energy. The 
problems in ^ and ^ involve single-user optimization of 
a sum of concave functions over a linear set of constraints, 
a similar of which was solved in lfT4l utilizing a generalized 
water-filling algorithm. In order to conform to energy causality 
and battery capacity constraints, this algorithm needs to be 
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enhanced as in Q with directional water-flow and taps, as 
demonstrated by the examples in Section |V] 

B. Convergence 

Optimality of the iterative solution follows from the convex- 
ity of the problem and the constraints. We start by stating that 
the rate function in the objective of Q as well as (|6]l and (|7j 
can be considered concave and non-decreasing without loss of 
generality. 

Lemma 1: Given any coding scheme achieving an instanta- 
neous rate of r'{pi,p2), one can construct a scheme achieving 
a rate r{pi,p2) concave and non-decreasing in pi and p2, that 
performs no worse than the given scheme. 

Proof: The proof for the non-decreasing property is 
straightforward, since a scheme can always choose to discard 
some of the allocated power to achieve the rate of a smaller 
power vector. The concavity property is shown using the fol- 
lowing time-sharing argument. Given r'{pi,p2) forpi,p2 > 0, 
define 



r{pi,P2) 



E,V'(p«,p(^)) s.t. A,>0, 



(8) 

as the maximum achievable rate using the given scheme 
and time-sharing. Note that all rates in the max term in ^ 
are achievable by time-sharing between the points (Pi'\p2 ') 
with corresponding parameters A, , while consuming the same 
average power for both users. For all power vectors, r{pi,p2) 
is at least as good as r'{pi,p2) since r'{pi,p2) can be achieved 
with Ai = 1. Finally, any rate achieved will be a convex 
combination of a number of points on r'{pi,p2), which means 
that a convex combination of two points can also be expressed 
as such. Since the rate at any point is the maximum of such 
convex combinations, r{pi,p2) is also jointly concave in pi 
andp2- Thus, r{pi,p2) defined in dHJ is an achievable, concave 
scheme that performs at least as good as r' {pi , P2) everywhere. 



We note that implementing such a scheme is feasible when 
the time scale considered is sufficiently long to allow time- 
sharing. Thus the actual capacity of this channel will also have 
to be concave, as is the case for all known interference channel 
regions with known sum-capacities. 

With the derivation of a concave rate function that we 
can effectively replace any coding scheme with, we state the 
convergence of the iterative algorithm. 

Theorem 1: The iterative algorithm given in (|6]l and (Q 
converges to the optimal policy. 

Proof: The iterative optimization approach among the 
variables of the problem, commonly referred to as the block 
coordinate descent method, is known to converge for a prob- 
lem in the form of 



max /(.Ti, X2, a;„) s.t. a; e A" 



(9) 



Cartesian product of convex sets Xi, X„. Furthermore, it is 
required for the objective function to yield a unique maximum 
in all variables x,, i.e.. 



max/(a;i,X2, . 



+ 1, 



(10) 



when the objective function / is continuously differentiable 
over X, and the feasible set X can be expressed as the 



needs to have a unique Q solving this problem ifTsl Prop. 2.7.1]. 

In the throughput maximization problem, we propose to 
perform the iterations over the power policies of the two users, 
partitioning the variable space into two, namely (pi,P2), 
yielding the iterations in ( I6I7I ). Since the two nodes harvest 
and consume the energy independently, the set of constraints 
on pi and p2 can be separated. The two constraint sets are 
also convex, since the individual constraints are linear in their 
respective elements pj^i. Thus the constraint sets do satisfy the 
requirements for convergence. 

For the objective function, we assume that r(pi,p2) is 
continuously differentiable, which would hold for any well- 
behaved achievable scheme over which r(pi,p2) is con- 
structed, as is the case for all known interference channel 
sum-capacity expressions. Additionally, it is required that the 
property in ( fTOl i is satisfied, which is yielding a unique maxi- 
mum for either user when the policy for the other user is kept 
constant. This requirement is trivially satisfied for a strictly 
concave objective function on a convex set X^. However, as 
stated by Lemma [T] for an interference setting without an 
explicit capacity definition, one can only guarantee concavity, 
and any claim of strict concavity is violated whenever time- 
sharing is used. This is overcome by introducing two auxiliary 
vectors Si and S2 and restating the maximization problem with 
the objective function 

5(Pi,P2, 81,82) = r(pi,p2) - e||pi - Slip - e||p2 - 82^ 

(11) 

to replace r(pi,p2) in Q, where e > is an arbitrary 
coefficient. It can be observed that the modified objective 
.9(Pij P27 81, 82) is strictly concave for a concave r(pi,p2), 
and thus a convergence statement holds for an algorithm using 
this objective for any positive e. Such an algorithm would cycle 
between pi,p2,8i and S2 in its iterations. The solutions to 
the iterations of auxiliary variables are trivial, with Si and S2 
assuming the values of pi and p2 respectively to minimize 
the euclidian distances in (fTTI) . On the other hand, iteration 
steps on pi and p2 suffer from the additional terms in (fTTI) 
that increases as they move away from Si and S2, which are 
equal to their values in the previous iteration. In essence, 
this modification employs a penalty on moving away from 
the previous value of the power policy, and can be thought 
of choosing the closest maximizer when the maximum is not 
unique if the values of e is taken to be sufficiently small. Since 
the block coordinate descent method for this strictly concave 
cost function converges for an arbitrarily small e ifTSl . so does 
the proposed iterative algorithm in (|6]l and ^ provided that 
in case of multiple maximizers, the one closer to the previous 
power vector is favored. We shall refer to this requirement as 
the minimum displacement rule in the sequel. ■ 
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IV. Examples 



as O 



With the convergence of the iterative algorithm verified, 
we now present examples on how the algorithm is applied 
in interference channels with known sum capacities. For 
convenience, we briefly summarize the directional water-filling 
algorithm introduced in ||7l since it provides valuable insight 
on the solution of the single user subproblems of the iterative 
algorithm. 



A. Directional Water-Filling for a Fading Channel 

Consider a fading communication channel with power-rate 
function r{p) = ^log{l + h ■ p) and an energy harvesting 
transmitter with energy constraints (|2]i and (|3]l as well as > 
for fc = 1, . . . , A^. To find the optimal power policy for the 
short term throughput maximization problem, we first compute 
its Lagrangian as 

iV N / k \ 

^= r^-%(l + /i.-pO-I]AfcK]r-p,-£j (12) 



JV-1 



r]k ■ Pk 



with Lagrangian multipliers {A;}, {p,i} and {rji}. Applying the 
Karush-Kuhn-Tucker (KKT) stationarity condition by evaluat- 
ing the gradient of C gives the optimal power policy as 



1 



(13) 



where Vi is the water level at the i time slot, evaluated 
as shown above. The KKT complementary slackness con- 
ditions indicate that Ai and fii are positive only when the 
battery is empty and full respectively, and zero otherwise; 
implying that water level increases and deceases only when 
the corresponding constraint is satisfied with equality. This 
yields a directional water-filling interpretation with base level 
1/hi, that satisfies energy causality by allowing water flow in 
only forward direction, and battery capacity by not allowing 
more than Emax amount of water to flow between any two 
time slots. The flow constraints ensure that increasing and 
decreasing water levels only occur when the corresponding 
constraint is active, and water level is equalized elsewhere, 
thus solving the power allocation problem for a single user in 
a Gaussian fading channel Q. 



B. Asymmetric Interference with ab > 1 

Asymmetric interference region is where one transmitter has 
a strong cross channel gain and the other has a weak one. It 
covers the two symmetric cases a < 1, 6 > 1 and a > 1, b < 
1. We shall assume the former case in this paper, with the result 
easily applicable to the latter case by switching transmitter 
indices. 

The capacity achieving scheme in the asymmetric interfer- 
ence with a6 > 1 is treating the weaker interference as noise 
and decoding and removing the stronger interference at the 
receiver. The power-rate function for this region and is given 



rA{Pi,P2) = -^log ( 1 



Pi 



1 + ap2 



P2) 



(14) 



We consider the iterations for each user separately while 
assuming that the power allocation policy of the other user 
is fixed. Denoting the sum rate as a function of only user j's 
power as r{pi), the single user power-rate function for Tl can 
be expressed as 

rA{pi)^^log{l + h-p,)+Ci (15) 

with h = T+ap7 ^"'^ ^1 ^ ^^og{l+p2)- The direct implication 
of this form is treating the interference term as channel 
fading h and using the directional water-filling algorithm. 
The solution for Tl reduces to directional water-filling in 
Subsection IIV-AI for which the channel fading parameter h 
in each time slot are updated with the output of the previous 
iteration for the second user, P2^^ at the fc*'' iteration. 

For T2, the single user power-rate function remains as 
the sum of two terms involving p2 and therefore does not 
simplify to a common form. Instead, we tackle the problem 
by evaluating the KKT optimality conditions. The stationarity 
condition requires 



dp2 



rA{P2) 



P2,n 



N 

E 

i—7i 







(16) 



on the n*'' time slot for every < < and ij2.n is 
the Lagrange multiplier corresponding to the nonnegativity 
constraint on the power level, P2 — 0- The complementary 
slackness conditions for this problem arise as 



A 



2,n 



T ■ P2,i = 0, \2,n > 0, 




T ■ P2,, 



2.max 



- J2 ^2,» = 0- M2,n > 0, 



Vn ■ P2,n = 0, r]n > 0, 



VO < ??. < N. 

(17) 



which imply that A2,n, M2,n and 772,71 are positive only when 
their respective constraint is active, i.e., when the battery is 
empty, full, or transmission power is zero respectively. As a 
consequence, the derivative term in ( fT6l ) remains unchanged 
over the transmission unless one of the above events occur. 
The impact of each event, either increasing or decreasing the 
derivative term, is determined by the sign of the corresponding 
multiplier in ( fT6b . For the fading channel this derivative term 
simplifies to the sum of inverse of fading parameter h and 
transmission power, thus yielding the well-known water-filling 
interpretation [16 |, as also seen in Subsection IIV-AI However 
in this case, the term remains as 



-T—rA{p2) 
dp2 



api 



1 



2{l + pi + ap2){l + ap2) 2(1 +P2) 



(18) 



serving as the generalized water level to equalize throughout 
transmission. Therefore the same directional water-filling so- 
lution with flow constraints applies to this problem when the 
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water level expression is replaced with the generalized level 
in ( fTSl l. This formalization is adopted from the generalized 
water-filling approach followed in 1141 . and a similar solution 
is proposed in ifTOl for the multiple access channel with energy 
harvesters. 

Since the iterative algorithm is shown to converge in Sec- 
tion [in] an iterative algorithm alternating between directional 
water-filling for Tl and generalized directional water-filling 
for T2 converges to the optimal transmission policy for the 
asymmetric interference channel with ab > 1. 



C. Asymmetric Interference with ab < 1 

In this subsection we consider the complementary asymmet- 
ric interference region to Subsection IIV-BI for which channel 
coefficients satisfy a < 1, 6 > 1 and ab < 1. The power-rate 
function for this region is given by 

, , . i Uog (l + + Uog(l+p2)\ 

[ ^log {1 + b ■ pi + P2) I 

(19) 

Note that the second term can also be expressed as 
^log (^1 + i^p^ ^ +-^log (1 + P2)- This rate is achieved similar 
to the ab < 1 case by decoding the interference of Tl at R2 
and treating interference as noise at R2. Since transmission 
of n needs to be decoded at both receivers in this scheme, 
the minimum operation decides which receiver will limit the 
transmission rate of Tl. 

We first tackle the single user problem for Tl. Upon 
investigation, it is easily seen that the value of p2 is sufficient 
to specify which of the two terms comes out of the minimum 
in (fT9] l. Specifically, the following threshold condition 

b-1 A 

P2 < r = Pc (20) 

1 — ab 

implies the dominance of the first term for the sum rate 
in (T% . Therefore, given a fixed transmission policy for the 
second transmitter, P2, which of the two terms will dominate 
the rate expression is known regardless of the value of the 
optimization variable pj^. Therefore, the single user problem 
can be considered once again as a single user problem with 
channel fading, and can be solved through directional water- 
filling of Q with the modified water base level defined as 



l_\l+ap2{t) P2{t)<Pc 
h-Y-±^ P2{t)>p, 



(21) 



The single user problem for T2 can be solved in a similar 
manner to its counterpart in Subsection IIV-B I using a general- 
ized water-filling algorithm with the adapted water level 



dr 



£ = i 2(l+pi+ap2)(l+ap2) + 2(l+p2) P'^i^) < Pc ^^2) 

Ud+fcpi+p.) P2{t)>Pc 



and an alternating iterative implementation of the two single 
user algorithms converge to the short-term throughput maxi- 
mizing power policy. 



D. Very Strong Interference 

The strong interference case was identified in ifTTll cor- 
responding to the case when the cross channel coefficients 
are large enough to ensure that the interfering signals can be 
decoded at both receivers. The rate for each user is therefore 
the single-link Gaussian channel capacity, achieving the sum 
rate 

rc{pi,P2) ^ log {1 + pi) +log {1 + P2) , a>l+pi, 6>1+P2 

(23) 

when the conditions above are satisfied. The iterative algorithm 
for such a rate function is trivial; for both users, a single link 
short-term throughput maximization as in |5j is to be followed 
in each iteration. Since the two subproblems are independent, 
no further iterations would be necessary to reach the optimal 
policy. However, the nature of the problem suggests that the 
transmission powers of the two users are varying, and thus the 
requirements in ( |23T l for the very strong interference region 
might not necessarily hold. The approach is justified when the 
output power vectors of the single user algorithms obey these 
constraints, which can easily be checked by comparing a and 
b with the maximum power of the two transmitters. 

E. Other Regions 

In previous subsections, it is observed that some single- 
user subproblems reduce to modified versions of directional 
water-filling for asymmetric interference and very strong in- 
terference. The sum-capacity expressions for the remaining 
interference regions either do not have single user rate ex- 
pressions yielding simpler approaches, or are not known such 
as the weak interference region with ^/a + \/b > 1. However, 
we know that any two-user problem with a concave power-rate 
function r{pi,p2) can be solved iteratively, using generalized 
directional water-filling for both single user problems. The 
KKT stationarity condition requires 



for user j at the n 
slackness conditions 



N 



^(Aj_i - Pj,i) 







(24) 



th 



A, 



time slot, with the complementary 



0, A, „ > 0, 




0, /ijv 



>o, 

(25) 



and the nonnegativity constraint pj.„ > 0. The optimal power 
at time slot i is then [PjJ^ where p'^ ^ is the solution 
to (|24] |. The interpretation of this result is the generalized 
directional water-filling analogy, with the alternative water 



level expression 



Ipj 



and the same unidirectional flow and 



maximum flow constraints. 

V. Extension to Data Arrivals 

So far the focus of this paper has been on the short- 
term throughput maximization with only the energy causality 
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T 2t / T 2t 

Fig. 3; A scenario where the iterative algorithm converges to 
a non-optimal point due to non-convex data constraints. 

(|2|i and battery capacity (O. In this section, we provide an 
extension to models where the data to be transmitted is not 
available before transmission, but instead arrives throughout 
the transmission with the size of arrivals in each time slot 
known to the transmitters beforehand. In this setting, the 
transmitter aims to make the best effort to send as many of the 
arriving bits as possible. This problem is particularly relevant 
when data collection or arrival process shows a significant 
variation. 

The problem with data arrivals is expressed in (|5]l with 
the additional data causality constraints in ( |5d] i. This set of 
constraints substantially affect the properties of the problem by 
imposing a joint constraint for the two users, as the individual 
rate achieved by each user is a function of both transmission 
powers. These constraints are not necessarily convex either, 
since a convex combination of two power vectors tend to 
increase the average achieved rate, potentially violating data 
causality constraints that held for the original pair of variables. 
Thus, the convexity and Cartesian product form properties of 
the constraints cease to hold, challenging the convergence of 
iterative algorithms for this setting. 

A simple example to why a direct implementation of 
iterative algorithms might fail to converge to the optimal policy 
is presented in Figure[3] Consider two transmitters Tl and T2 
with the former having a large amount of data available at the 
beginning of the first time slot, and the latter having only a few 
bits to send at first, with more data arriving at the beginning 
of the second time slot, as marked with the green arrows. Let 
the harvested energies of these two nodes be so that the water 
levels result as in the figure, with T2 sending exactly B2.1 
bits at the first time slot with this assignment. Notice that 
without data causality constraints, Tl would favor equalizing 
its water levels in the two slots. However, an attempt to do so 
in an iteration step decreases the interference of T2, violating 
its data causality constraint at the end of the first time slot. 
Thus an iterative algorithm is stuck at these water levels. On 
the other hand, if Tl were to equalize its water levels, T2 
would also benefit from this since it would require less power 
for the first 52.1 bits, and both users would have more power 
in the second time slot, yielding better performance. 

As observed in the example above, the data causality 
constraint may cause an iterative algorithm to not converge 
to the global optimum. However, without this constraint, we 



know the convergence of the algorithm with a minimum dis- 
placement rule due to Theorem[T| Thus, in order to increase the 
chances of the iterative algorithm to converge to the optimal 
policy, we follow an alternative approach and handle the data 
causality constraints in a more relaxed manner to prevent cases 
such as in Figure |3] We suggest doing this by employing 
a quadratic penalty for the data constraints, the coefficient 
of which starts at zero and is allowed to grow indefinitely 
with iterations. When this approach is followed, at earlier 
iterations, the effect of data causality constraints is relatively 
small, allowing the nodes to explore the otherwise infeasible 
regions of the power space. However with increasing penalty 
coefficients, data causality constraints become strict, forcing 
the algorithm to converge to a power vector conforming to 
data-causality. The optimization problem then becomes 

N N 

max V't • r(pi.i,p2.j) - efc !|C„||^ (26a) 
pi>o,P2>o ^— f ^ — ; 

1—1 n—i 
n 

s.t. ^ {Ej^, - T ■ pj^i) > 0, (26b) 
1=1 

n 

{t ■ Pj,i — Ej,i) + Ej^rnax — Ej,i+i > 0, 

4=1 

(26c) 

where C„ is the measure of data causality violation at the 71*'' 
time slot, expressed as 

n 

Cn = mm(0,y^ (t • rj{pj,i) - B-j^i)), (27) 
1=1 

and efc is the penalty parameter for the fc*'' iteration, increasing 
unboundedly with k. 

For a continuous objective function and closed constraint 
set, the penalty function method is observed to have good 
convergence properties in practice ifTSI . making it a good can- 
didate for the energy harvesting problem with data constraints. 
The addition of the penalty term to the objective affects the 
water-filling algorithm for each user by creating an offset 
term in the water level expression whenever a data causality 
constraint is violated. This offset term is scaled by e^, starts 
less effective and gradually becomes strict with increasing 
efc. This can be interpreted as an additional pump element 
between time slots, forcing water-flow in either direction until 
the water-level difference matches the offset term. As ek 00, 
any nonzero offset term grows indefinitely, strictly requiring 
complying with data causality. An offset term is increasing in 
a users power if the corresponding constraint is of the same 
user, and decreasing otherwise. Thus, the pump element forces 
water flow in the forward direction when data causality for 
the user in consideration is violated, or backward when data 
causality for the other user is, until the difference in water 
level matches the offset term. 

An example algorithm run is demonstrated in Figure |4] 
for a single transmitter with N = 5, energy arrivals E = 
[1,0,1,0.5,0], Ernax = 1, data arrivals B = [0,1.5,0,0.2,1] 
and linear power-rate function r{p) ~ ^ for simplicity. The 
taps shown in red correspond to the battery capacity constraint. 
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E,^l £3 = 1 £, = 0.5 

Bj=1.5 I ||«4=0.2 1^5 = 1 (a) 

T 2t 3t 4t 5t t 




T 2t 3t 4t 5t ; 




T 2t 3t 4t 5t t 



Fig. 4: (a) Energy and data arrival scenario, (b) initial water 
levels and (c) final water levels for a sample directional 
water- filling algorithm with pumps. Elements corresponding 
to violated or active constraints are marked with an 



and resist water flow after a total flow of Emax including 
the energy harvest to the next time slot. The bidirectional 
pumps shown in green relate to the bit causality constraint, 
and activate in forward direction when more bits are being 
departed than received by the transmitter. Active elements of 
the algorithm are marked with an asterisk. The algorithm starts 
with the received energies placed in respective slots (b). When 
water flow is performed, the resulting policy and remaining 
active constraints are shown in (c). This corresponds to the 
water distribution for which any increase in water level is due 
to a forward pump or energy causality, and any decrease in 
water level is due to a reverse pump or a battery capacity tap. 

An interesting outcome of the pump modification is the 
possible tension of algorithm elements. It is possible in some 
extreme cases that the forward pump for data causality and the 
tap for battery capacity are active simultaneously. An example 
of this is given in Figure |5] Consider a single user problem 
in two time slots with Ei = E2 = E,nax, Bi = and 
B2 > 0. Since there is no data to send in the first time slot, 
any transmission would violate data causality and therefore 
the forward pump between slots 1 and 2 shown in green in 
Figure |5lb) stays active until there is no water in slot 1 as 
e — >■ 00. On the other hand, since the second slot receives an 
energy of E2 = Emax, the tap shown in red is also active, 
not allowing any water to be pumped into the slot. It is trivial 
in this example that the first energy arrival is useless and will 
inevitably be lost, which is what the contradiction between 
algorithm elements also implies. In such cases, the water 
causing the contradiction is removed without any reduction in 
the performance of the optimal policy shown in Figure |5jc). 

In specific cases, the individual rate achieved by one 
transmitter is independent of the transmission power of the 
other user Some examples to these cases are the very strong 
interference in Subsection IIV-DI where individual rate of 
transmitter j is ^log{l + Pj), or the asymmetric interference 



E2 ^ max 

[a) 



t 2t 




T 2t 




T 2t ? 

Fig. 5: Contradiction and resolution between modified direc- 
tional water-filling algorithm elements. 

in Subsections IIV-BI and IIV-CI where the individual rate of 
T2 is ^log{l + P2) regardless of the transmission power of 
Tl for a < 1, 6 > 1. In such cases, the cross dependence of 
constraints vanishes, and the directional water-filling algorithm 
with pump analogy is applicable without the backward-pumps. 
Note that in this manner, the pump extension is also a solution 
to the single link optimal power allocation problem with 
energy harvests, battery capacity and data arrivals. 

VI. Distributed / Online Algorithms 

The optimal policies calculated using the proposed iterative 
algorithms require the knowledge of energy and data arrival 
settings of both transmitters at a centralized controller prior 
to the transmission to perform the iterations. In practice, such 
information may not be available or may not be desired to 
be shared. In this section, we propose near-optimal algorithms 
that require less information and thus are more realistic using 
the insight gained from the optimal iterative solution. 

An important result of this paper is the convergence of 
single user iterative algorithm, and it is observed in Section ITVl 
that the single-user subproblems can further simplify or be 
independent of the other user. The role of the single user opti- 
mization problem in the optimal offline solution indicates that 
when the model is restricted to localized power decisions at 
each transmitter, i.e., without any knowledge about the energy 
or data arrivals of other transmitters, a reasonable algorithm is 
to determine policies using a single link water-filling approach 
while assuming expected values for the unknown parameters. 
In very strong interference case, this algorithm matches the 
optimal offline policy; whereas in weaker interference cases, 
further iterations only provide gradual improvements on the 
policy. This simplified approach performs surprisingly well, 
as demonstrated through simulations in Section IVIII 

Another case is when the energy and data arrivals are not 
known by the transmitters prior the transmission, and trans- 
mitters are to choose power policies as energies and packets 
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J(ei, 62,61,62,*) = max r • r{pi,p2) + E 

Pl,P2 



'ei - Pit + Ei^i+i, 62 - P2T + E2.i+i, 
J\ bi - ri{pi,p2) + Bi^i+i, 

62 - r2{pi,P2) + B2,i+i, i + 1 



(28) 



arrive. When data and energy harvests are independent in time, 
it is reasonable to represent the state of the system at any time 
using only Markovian states such as battery levels, data queue 
lengths and time before deadline. The power decision made 
by a transmitter at time t is then a function of the subset of 
available states to said transmitter, depending on whether it is 
feasible to share the states of a node with the other The online 
optimal policy in this formulation can be computationally 
obtained using dynamic programming techniques similar to 
for example in l?]. Denoting the battery and data queue states 
of user j as bj and ej respectively, current time slot index 
as i, and assuming all states are available to all transmitters, 
the Bellman equation for the problem is given in ( |28] l, where 
J(ei, 62, 61, 62, is the value function of a given state and E[.] 
is expectation based on the arrival processes. When the fixed 
point for the above recursive problem is found, the optimal 
online transmission algorithm for the interference channel 
becomes the arguments of the maximization in ( |28] l for the 
corresponding system states. 

VII. Simulations 

In this section, we present simulation results of the iterative 
algorithms proposed in this paper We start by comparing the 
outputs of single user directional water-filling and two user 
iterative directional water-filling in a short time scale. We con- 
sider the throughput maximization problem in the asymmetric 
interference region with a6 < 1 as in Subsection IIV-BI We 
choose a model with time slot duration t = 1 sec, deadline 
T = 20 sec, battery capacities Ei^max = E2.max = 10 mJ 
and channel parameters a ~ 0.9 and h — 2 for receiver noise 
spectral density N^s = ^0,2 = IQ^^'^W/ Hz, bandwidth 
IMHz and direct channel coefficients hn = /122 = —IQQdB. 
The sum capacity for this parameter region is given in (fl4] i 
after normalization. We assume sufficient number of bits is 
available at both transmitters prior to transmission, and the 
following randomly generated energy arrival vectors 

El = [5, 0, 0, 0, 3, 0, 0, 0, 0, 0, 7, 0, 0, 0, 4, 0, 0, 0, 6, 0] mJ 

E2 = [10, 0, 7, 0, 0, 0, 0, 0, 9, 0, 0, 5, 0, 8, 0, 5, 0, 0, 0, 0] mJ 

as marked with purple in Figure |6] in mJ for Tl on left 
and T2 on right. When single user directional water-filling is 
performed for both transmissions independently, the resulting 
power policy is shown in Figure |6] However when the iterative 
algorithm is utilized, the optimal power policies arise as in 
Figure [T] shown in blue for Tl and red for T2. Recall that 
the algorithm for asymmetric interference channel suggests 
directional water-filling with base level = 1 + p2, shown 
in green, for Tl; and generalized directional water-filling for 
T2. The interaction of the two power policies can be observed 
in the optimal policy, such as when Tl remains silent while 
T2 has high power at time slots i = {1,2}, or when T2 
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Fig. 6: Energy harvesting scenarios and power allocations with 
single-link directional water- filUng Q for Tl (left) and T2 
(right). 




5 10 15 20 5 10 15 20 

Time (sec) Time (sec) 



Fig. 7: Optimal power allocations with iterative directional 
water-filling for Tl (left) and T2 (right). 

significantly reduces transmission power when Tl is highly 
interfering at i ~ {19,20}. The effects of such interactions 
is notable even in this two user model, and would be even 
more critical for a higher number of users sharing the same 
medium. 

Next we compare the performances of the optimal iterative 
algorithm, the distributed near-optimal directional water-filling 
suggested in Section IVII and naive nodes that do not perform 
any kind of algorithm to adapt the energy harvesting process. 
The naive nodes attempt constant power transmission with the 
expected energy harvest rate at each time slot if sufficient 
energy is available, and transmit with all remaining energy 
otherwise. We assume a Gaussian interference channel with 
receiver noise spectral density A'o,! = No,2 ~ lO^^^W/Hz, 
bandwidth IMHz and channel coefficients hu — h22 = 
-lOOdB, hi2 = -101.55rfB and /i2i = -93.01dB yielding 
channel parameters a = 0.7 and 6 = 5 after normalization, 
falling in the asymmetric interference region of Section IIV-BI 
For battery capacities Emax,i ~ E,nax.2 = 10 mJ, we 
generate energy arrivals with energy distributed uniformly in 
[0, Emax] and interarrival times distributed exponentially with 
mean 5 sec, quantized to time slots of duration r = 1 sec. 
For this setting, the cumulative departures of these algorithms 
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Fig. 8: Simulation of iterative directional water-filling, single 
user directional water-filling and naive algorithms in asymmet- 
ric interference setting with a = 0.7, 6 = 5 and bandwidth 

IMHz. 



are plotted in Figure [8] It is apparent that the water-filling 
algorithms provide notable performance increase over the 
naive approach. Moreover, it is observed in this simulation 
as well as others with different parameters that the single 
user directional water-filling performs very close to optimal, 
making it a favorable candidate for practical applications. 

VIII. Conclusion 

In this paper, the short term sum-throughput maximization 
problem for a two-user Gaussian interference channel with 
energy harvesting nodes was formulated and solved with an 
iterative algorithm. It was observed that, in some cases, includ- 
ing asymmetric interference and very strong interference, the 
resulting generalized iterative water-filling algorithm reduces 
to modified versions of single-user directional water-filling. 
Furthermore, the model was extended to the scenario with 
stochastic data arrivals by introducing a pump element to 
the directional water-filling algorithm through a penalty for 
data causality violation. With the insight from the optimal 
solution, computationally simpler near-optimal alternatives for 
online and distributed versions of the problem were suggested 
and demonstrated along with the iterative approach. The 
performance of the suggested iterative directional water-filling 
algorithm and its distributed near-optimal counterpart were 
verified through simulations, showing a notable performance 
boost over naive algorithms. 

Being the building block for multi-user interference net- 
works, the results for the interference channel serve as a 
starting point for energy harvesting interference networks. This 
addresses practical interests in analyzing and optimizing the 
upcoming generation of energy harvesting networks. Future 
directions for this topic would be extensions to more than two 
users and more elaborate multi-hop network structures as well 
as simpler online algorithms to adapt to energy availability 
and interference levels simultaneously. 
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